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Abstract 

Under some mild regularity on the normalizing sequence, we ob- 
tain necessary and sufficient conditions for the Strong Law of Large 
Numbers for (symmetrized) U-statistics. We also obtain nasc's for the 
a.s. convergence of series of an analogous form. 

1 Introduction. 

The general question addressed in this paper is that of necessary and sufficient 
conditions for 



— y^£i/i(X s ) — > 0, a.s. 



lu iei„ 



where I n = {i = (ii,i 2 , . . . ,i d ) : 1 < h < i 2 < ■ ■ ■ < id < n}, {Xj}f =l is 
a sequence of iid r.v.'s, X[ = (X^, ■ ■ ■ ,X id ). With no loss of generality we 
may assume that h is symmetric in its arguments. 

Further, as in [|CGZ|1 and in \\Zhl\\ , it is also important to consider the 



question of the almost sure convergence to zero of 

— max |/i(Xi)|. 
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In fact, it is through the study of this problem that one is able to complete 
the characterization for the original question. 

Without the symmetrization by Rademachers, Hoeffding ([H]) in 1961 

proved that for general d and 7„ = Q) , mean zero is sufficient for the nor- 
th 

malized sum above to go to zero almost surely. And, under a p moment 
one has the a.s. convergence to zero with 7„ = tip ([g] when < p < 1, in 
the product case with mean zero [[IJ for 1 < p < 2 and in the case of general 
degenerate h ||GZ|| for 1 < p < 2). 

It is somewhat surprising that it took until the 90's to see that Hoeffding's 
sufficient condition was not necessary (|GZ|). In the particular case in which 
d = 2, h(x, y) = xy and the variables are symmetric, necessary and sufficient 
conditons were given in ( ||CGZ|] ) in 1995. This was later extended to d > 3 by 
Zhang ( ||Zhl|| ). Very recently Zhang |[Zh2|| obtained "computable" necessary 
and sufficient conditions in the case d = 2 and, in general, found equivalent 
conditions in terms of a law of large numbers for modified maxima. Other 



related work is that of JM| in which the different indices go to infinity at 
their own pace and |G[ in which the variables in different coordinates can be 
based on different distributions. 

In this paper we obtain nasc's for strong laws for 'maxima' for general d. 
This likely would have enabled one to complete Zhang's program. However, 
we also found a more classical way of handling the reduction of the case of 
sums to the case of max's. 

The organization of the paper is as follows. In Section 2 we introduce the 
necessary notation and give the basic Lemmas. Now the form of our main 
Theorem is inductive. The reason we present the result in this form is that 
the conditions in the case d > 2 are quite involved. Because of the format 
of our Theorem we first present in Section 3, the case that the function, h, 
is the product of the coordinates. As mentioned earlier, this case received 



quite a bit attention, culminating in Zhang's paper (pEjJ). In the first part 



of Section 3 we show how the methods developed in this paper allow one to 
give a relatively simple, and perhaps transparent, proof of Zhang's result. 
We, then, prove the main result, namely, the nasc's for the Strong Law for 
symmetric U-statistics. Again, because of our inductive format, in order to 
clearly bring out the main idea's of our proof, we also give a simple proof of 
Zhang's result for the case d = 2. 

Finally in Section 4 we consider the question of convergence of mul- 
tidimensional random series Xagz d ^i(^i)- We obtain necessary and suf- 
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ficient conditions for a.s. convergence in the case of nonnegative or sym- 
metrized kernels. This generalizes the results of |[KW1|| (case d = 2 and 
h itj (x,y) = a i:j xy). 



2 Preliminaries and Basic Lemmas. 

Let us first introduce multiindex notation we will use in the paper: 

• i = (ii, i 2 , ■ ■ ■ , irf)-multiindex of size d 

• Xi = (Xi t ,Xi 2 , . . . ,X id ), where Xj is a sequence of i.i.d. random vari- 
ables with values in some space E and the common law \i 

• X 1= (xg\xg\ ... , xff), where (xf ] ), k = 1, . . . , d are independent 
copies of (Xj), 

• Ei = Si x Si 2 ■ ■ ■ e id , where (ei) is a Rademacher sequence (i.e. a sequence 
of i.i.d. symmetric random variables taking on values ±1) independent 
of other random variables 

• £i = ^Mjf ■ • , where (e^) is a doubly indexed Rademacher se- 
quence independent of other random variables 

• fJ>k — ®i=iA* " product measure on E k 

• for I C {1,2, . . . ,d}, by Ej and E\ we will denote expectation with 
respect to (X^) k£l and (X k ) k ^ respectively 

• i 7 = (i k ) keI and /' = {1, 2, . . . , d} \ I for I C {1, 2, . . . , d} 

• I n = {i = (ii, i 2 ,... , id) ■ 1 < k < «2 < • • • < id < n}, 

• C n = {i = (k, i 2 , . . . , i d ) ■ 1 < ii, *2, • • • , id < n} 

• A J ' X = A XI = {z e E 1 : 3a e A,aj = x r , a v = z) for A C E d ,I C 
{l,...,d}. 



The results in this section were motivated by the difficulty in computing 
quantities such as: 

P(max/i(X i ,F j ) > t), 

i,j<n 
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where {X{\ are independent random variables and {Y{\ is an independent 
copy, and h is, say, symmetric in its arguments. 

In the one-dimensional case, namely, P(maxj< n £j > t), where are 
independent r.v.'s, we have the simple inequality 

^mm(J2 P (\d\ > t),l) < P(max|&| > t) < min(^P(|&| > t),l). (1) 

i i 

If this type of inequality held for any dimension, the proofs and results 
would look much the same as in dimension 1. Here we give an example to 
see the difference between the cases d — 1 and d > 1. 

Consider the set in the unit square given by: 

A = {(x,y) € [0, l] 2 : x < a, y < b or x < b, y < a} 

and assume that the Xi,Yj are iid uniformly distributed on [0, 1]. By ([!]) it 
easily follows that 

P( max I a (Xi, Yj) > 0) ~ min(na, 1) min(n&, 1), 

l<jj'<n 

which is equivalent to Y^j=i P(^A{Xi, Yj) > 0) ~ n 2 ab if and only if both a 
and b are of order 0(-).D 

Lemma 1 Suppose that the nonnegative functions fi(xi) satisfy the following 
conditions 

fi(Xi) < 1 a.s. for all i (2) 
Ei h(Xi) < 1 a.s. for any I C {1, 2, . . . , d}, < Card(J) < d (3) 

i/ 

Let fhx — E J2i fi(Xi), then 

E(J2h(X i )) 2 <m 2 1 + (2 d -l)m 1 (4) 

i 

and 

P(52M*i) > > 2- d - 2 min(m 1 , 1). (5) 
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Proof. Let S(d) denote the family of nonempty subsets of {1, ... , d} and 
for a fixed / G S(d) and i let 



E(J2f i (X i )) 2 <(Ej2f i (X i )f+ ^ E i E 'ih(Xi) E 'i E 

i i I&S(d) i j'£J(i,/) 

^ m i + E E E i E 'if^ = m l + (2" - !) m i- 



The inequality (§]) follows by (§) and the Paley-Zygmund inequality. □ 

The next Lemma is an undecoupled version of Lemma 1, the proof of it 
is similar as of Lemma 1 and is omitted. 

Lemma 2 Suppose that the nonnegative functions fi(x{) satisfy the following 
conditions 



J(i, I) = {j : j/ = i 7 and j fc 7^ i fc for all kjl}. 



Then we have by (0) and (Q) 



i"GS(<f) i 



fi(Xi) < 1 a.s. /or a// i 



and 



£j E fi( X i) ^ 1 a - s - /° r al1 i andl C {1, 2 

i€J(i,/) 



d} ; < Card(J) < d , 



where 



J(SJ) = {y- {k : 3i i k = ji} 



I}- 



Let rrii = E J2i fi(Xi)> then 




(6) 



and 



p(E/i( x i)>^)> 2 



-d-2 



min(m 1 , 1). 



(7) 



6 



R. LATALA AND J. ZINN 



In the rest of this paper we will refer to the next Corollary as the "Section 
Lemma" . 

Corollary 1 If the set A C E satisfies the condition 

n^Hd-iiA 1 '* 1 ) < 1 a.s. for all I c {1, . . . , d} with < Card(J) = l<d 
then 

P{B leCn Xi G A) > 2- d - 2 mm(n d fi d (A), 1) 

and for n> d 

P(3 ie/ „Xi G A) > 2- d ~ 2 d- d mm(n d fi d (A), !)■ 

Proof. The first inequality follows immediately by Lemma |l] applied to 
f\ = I a- To prove the second inequality we use Lemma |2] and notice that 

min(rM// d (A), 1) > rf- d min(nVd(^), !)■ □ 



3 Strong Laws of Large Numbers 

We will assume in this section that the sequence j n satisfy the following 
regularity conditions 

7 n is nondecreasing (8) 

l2n < C'jn for any n (9) 

< C— for any / = 1,2,... (10) 

k>l 7 2 fe % l 

As mentioned in the Introduction we first give a proof of Zhang's result 
Zhlf for the product case i.e. h(x) = nti Xi for x G R d . To state the SLLN 



in this case we need to define numbers c n by the formula 

X 2 

c n = min{c > : nE{— A 1) < 1}. 

cr 
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Theorem 1 Assume that h(x) = Yii=i x i> an d that the r.v.'s Xi are sym- 
metric. Then, under the regularity assumptions ^-(fTZ^, the following are 
equivalent: 



^Ew^En^-o., (ii) 



2 M P(Y[X? > -^gjy, minX 2 > 4) < oo /or a// 1 < I < d. (12) 



fc=l r=l C 2*= 



Proof. We give only the proof of the necessity of the conditions (|T2D. The 
sufficiency can be proved as in the Theorem 0. Let 



(r) 2 



i r =l 

and 



(r)i A c 2 . 



i r =l 



Step 1. We first reduce to the sum of squares, i.e. we will show that 
condition ( |TT1) implies 

^ 2 EIl X v-0a.s. (13) 

iei"n r=l 

By the symmetry of X we have that 7" 1 J2iei Ylt=i £ v^v — * a - s - Thus for 
a. a. sequences (Xi), the Walsh sums (i.e. the linear combinations of products 
of d Rademachers) converge to a.s. Hence, they converge in probability. 
This implies (by a result of Bonami about hypercontractivity of Walshes IBJ ) 
that for a.a. sequences (Xi), 7~ 2 Xae/ lXLi^ir — * and (|13"D is proved. 

Step 2. We now go to a diadic subsequence and then decouple. By the 
Borel-Cantelli Lemma, the condition ( O ) implies that 

oo d 
fc=l ie/ 2 fc_i r=l 
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Now let us notice that I 2 k D {i G I 2 k : (r - l)2 fc ~' < i r < r2 k ~ 1 } if I is such 
that 2' > d. Moreover the random variables in these blocks are independent 
of the other blocks, thus we obtain 

oo d 

v £ >o e p ( e ri( x i r) ) 2 ^ ^) < °°- 

fc=/+l ieC 2fc _ ; _i r=l 

Hence, using the regularity assumption (|9|) 

oo ci 

V £ >o E P (II T i ) >^ 2 2 fc )<oo. (14) 

fe=l r=l 

Step 3. At this point we use 1-dimensional case of Lemma 1. We apply 
it to 

2mM/ \ \ ^ v^i 



3=1 n 



and notice that Ec n 2 Tn (c n ) = 1 by the definition of c n . We get that 



Hence 



and 



d 2(d-l) d 2(d-l) 1 

f( II r i r) > ^ > ^( II r i r) M £ %=r) £ (|)" 

r=l+l r=l+l 



2(t»-J) ■ 

r=l r=l 

Thus condition fli~4]) yields 

oo Z 2 

E p (. ma - n( x r) 2 >^fc))<^ as) 

fc=l r= l C 2fc 

Now, here is the main point. 
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Step 4. At this point we need to replace the max inside the probabil- 
ity with 2 kl outside the probability. To do this we use the Section Lemma 
(Corollary 1). 

To get small sections there are a variety of choices. To obtain Zhang's 
result, we reduce the probabilities even further by intersecting the sets in the 
following manner. 

oo / 2 

T.\ ■^II(*£ , > , W>*> > < 00 

fc=i *>•••>«- r= i c 2fe 



To see why we have small sections, just note that 

P(x > > 4.) < ^IpMl = i 

c 2fc / 
Now we just use the Section lemma to get 



E 2 ^(n^>^>^))<°° 

Or, equivalently, 



fc=l r=l C 2 



oo I 2 

fc=l r=l C 2fe 

which yields ©. □ 

In Theorem § we reduce the SLLN for symmetric or nonnegative kernels 
to a SLLN for "modified maxima" . To see what this means consider the case 
d = 2. Then, 

A k , 2 = {(x, y)eE 2 : h 2 (x, y) < 2 fc ^/i 2 / ft2 < 7afc (x, Y) < 7 2 fc , 

2 fc E x / i 2 4 2 < 72fc (X, 2/ ) < 7 2 2 fc }. 

So that 

{3i e C 2 fe, XtfA k2 } = {maxy?(Xi) > j 2 k }, 

iec 2fe 

where 

<p(x, y) = h 2 (x, y) V 2 k E Y h 2 I h 2^ 2k (x, Y) V 2 k E x h 2 I h 2^ k (X, y). 
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In ||Zh2|| Zhang, using different methods, also reduced the probem to 



"modified maxima" . We continue in Theorem ^| to find nasc's for the SLLN 
for the maximum, which, hence, could also be used to complete Zhang's 
program. 

For a measurable function h on E d which is symmetric with respect to 
permutations of the variables, we define for k — 1,2,... 

A kA = {x E E d : h 2 (x) <^ k } 

and for I — 1, . . . , d — 1 

Ak,i+i 

= {xe A k>l : 2 kl E I h 2 I Ak l (x) < 7 2 \ for all / C {1, 2, . . . d}, Card(J) = I}. 



Theorem 2 Suppose that assumptions are satisfied and the sets A ky 



■i 



are defined as above. Then the following conditions are equivalent: 

— ^£ih(Xi) -> a.s. (16) 



7 " ta n 



— ^£i/i(Xi) ^0 a.s. (17) 



7 « iec, 



7n ie/n 



\ h 2 ^) - a.s. (19) 



iec„ 



^P(3 ie/2fc X^A kid ) <oo (20) 



k=l 



oo 

p (3 ie c 2k X-4A Kd ) < oo 

fc=i 



(21) 
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Proof. (|16D =>• ([Op and (|T7 D =>(|T§ D - proofs of these implications are the same 
as in Proposition 4.7 in [|CGZ|| (see also Step 1 in the proof of Theorem 1) 

fl]]D=5>(|n5D Let I be such that 2 l > d. By the regularity of 7„ (§),(§) and 
the Borel-Cantelli Lemma, (pl|) and fllTf ) are equivalent, respectively, to 



P( h2 ( Xi ) ^ < 00 for all e > (22) 

and 



fc=l ie/ 2fe 



^ P( Y - < 00 for a11 5 > °' ( 23 ) 

fe=H-l iGC 2fe _i 

Let 

D k = {i : (m - l)2 fc_i < i m < m2 fc "' for m = 1, . . . , d}, 
then for k > I we get 

P(£ /i 2 (X,) > e 7 2 fe ) > P(J2 h\X,) > e^) 



i£C 2 k-i 

and (jg) implies (0). 

(|18D=^(pOD We will prove by induction that for I < d 

oo 

J>(3 ie / 2fc X i /A M )<oo (24) 
fe=i 

For I = 1 (0) is J2T=i p ( 3 ie/ 2fc ^ 2 ( x i) > 7 2 2 *) < 00 and follows easily by the 
Borel-Cantelli lemma. Assume that (|24] ) holds for Z < d — 1. To show it for 
/ + 1 it is enough to prove that for any / with Card(J) = I 

oo 

5>(3 i/6/2 , 2 kl E I h 2 I Ak4 (X i ) > 7 2 \) < oo (25) 
k=i 
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By the symmetry of the kernel h we may and will assume that I — {1, . . . , /}. 
From (|18D it follows that 



^ E ^ 2 ^ o a . s .. 

'2 fe iei„ 



By the regularity of 7 2 fc (P) and the Borel-Cantelli Lemma we get that 



oo _ 

E p ( E h2 w^) > ^ 2 2k ) < oo. 



fe=i ie/ 2 fc + i 

But 



Pj( E > k 2 ,) > P/( max E > ^7? 



. , - ■ - J 2 k ■ , 

iG/ 2 fc + i i/6/ 2 fc 



> m ax P 7 (E > i-ri), 



where 

J 2k = {(?!, . . . , : 2 fc < ij < i 2 < . . . < i d _i < 2 k+1 }. 

Let us notice that by the definition of Af.,i we have for any J d I with 
Card(J) = m < I 

2 km E J h 2 I Akl (X i )< 1 2 2k . 
Therefore by Lemma ^| we get that 

.max Pj( E h 2 I Akl {X,) > \-&) > 2^ 2 
i/e/ 2 fc 



if max ij/6 j 2fe £/E i/e / 2fc h2l A k<l ( x i) > Hence 

^(E^mW > k 2 *) > 2-'- 2 P(3 yeJ2fc 2 fc W/ 4M (X i ) > 7 2 



ie/. 
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and (j25|) follows. 

0l9|)=^(pID This is the same as the above, except we use Lemma [3] instead 
of Lemma |2|. 

(pOD=^ (|16D . By the regularity assumptions (||), (Q) and the Borel-Cantelli 
Lemma it is enough to prove that for any t > 



X 

J^P( max I ^£i/ipfi)| > t) < oo. 



fc=i ' 2 ~ ie/„ 



By our assumption (^) it is enough to show that 

oo ^ 

J2 p (— m ^\J2 £ih w^)\ >t)<oc. 



7ofe n<2 fc ^ 

fc=i M ~ ie/„ 



Since <i n = ^ ie/ E\hl Ak d {X\) is a martingale, by Doob's maximal inequality 

we get 



P(^max|5>WA M (jri)| >*) 



7 2* iG/ 2fc * 7 2 fc 



Thus it is enough to show that 



oo „<2A; 

E^2^ M (X)<oo. (26) 



fc=l 7 2 



Let r = inf{A; : X G ^4fc,d}, then X G A T(i \ A T „ ljrf so by (PH) we get 

k=l ^2 fe fc=T '2 fe 



< ^-^^(1) < Cj2E-^h 2 I AkAAk _ hd (X). 

72T fc=l 7 2 fc 
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Let us notice that by the definition of Af.^ we have h 2 (X)lA k d \A k _i d {X) < 7^ 
and E^tflA^A^ ^X) < 7^ for any / C {1, . . . , d} with < Card(J) = 
/ < d. Thus by Lemma |^ 

2- d - 2 min(f 2 y)^/ i 2 ^,^_ ld (X),l)<P( h 2 I AkAAk _ 1M (X i )>0) 

< P(3 ie/2fc _ 1 X i G A M \ 4fe_ M ) < P(3 ie/2fc _ 1 X i ^ fc _ M ). 
So condition (p0|) implies that 

^min(-^ J E/i 2 / Afcd \ Afc _ l d (X),l) < 00 
fc=l '2 fe 

and fl26|) easily follows. 

(pT]) ^> (pT6j) and (pT|) ^> CpT7|) In the same way as above we show that (pT|) 
implies (p6|) and that ( f26[) implies fll7l) . □ 



The next Theorem will show how to deal with the condition (|20"D . Suppose 
that the sets Ak are given and let us define the sets Ck,i and Bkj for / C 
{1, . . . , d} with Card(J) = / by induction over d — I: 

Ck,d = A k 

B k>1 = {xj G E l : 2 k ^ f i d _ l (C x k ; i+1 ) > 1 for Card(I) = 1} 
Ck,i = {x G Ck,i+\ '■ xj(B k i for all / with Card(J) = /}. 
Theorem 3 

00 

Y, P ^ei 2k XiGA fc )<oo (27) 

k=l 

if and only if the following condition are satisfied 

00 

V«=i,... i d-iV/ C {i v .. id } i card(/)=/ / ^ P(^\ei 1 ,. G B k j) < 00 (28) 

k=i 

00 

Y,^ d UCk,i) <oo. (29) 
fc=i 
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Proof. Let us notice that (p9|) immediately implies that 

oo 

J2 P ^ei 2k X,GC M )<oo. 
fc=l 

Since by the definition of sets C^: 

{3 ie/2fc X; G 

d— 1 

C {3 iel2k X, G C7 M } U |J |J {\ eI[k X h G S fei/ }, 

1=1 IC{l,...d},Caxd(I)=l 

hence @ and (||) imply (0). 

To prove the second implication let us first notice that by the definition 
of Ck,i we have 

2 fc( ^ m) /id-m(Cfcj) < 1 for any I with Card(J) = m>l. (30) 

Hence by Corollary 1 

P(3 ie/afc X; G A k ) > P(3 iel2k X, G C ktl ) > c d 2 kd fi d (C kA ) 

so (g7|) implies (H). 

By Corollary 1 and (|30T) we also get that for any I C {1, . . . , m} with 
Card(J) = I = 1, . . . , cf — 1 we have for J = I c and any x/ G E 

n\eiv x ^ e C *Ui) > c d ^ d - l ^ d ^{Cl* l+l ). 

•' 2 fc 

Thus 

P(3 ie/afc X G A fc ) > P(3 ie/afc X G C M+ i) > c d ^P(\ a ^ X h G S fc>/ ) 
and (|3) implies (||). □ 



3.1 Two-dimensional Case. 

In the two-dimensional case let us define for k = 1,2, 

/,(x)=2%(/ J 2 (i,F)A 72 \). 



(31) 
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Theorem 4 In the case of d = 2 each of the equivalent conditions (16)-(2J_) 
is equivalent to the following condition 

oo 

^2 fc P(/ fe (X)> 7 2 2 fc )<oo (32a) 

k=l 

and 

oo 

2 2k P(h 2 (X, Y) > 7 2 fc , f k (X) < i 2 2k ,f k (Y) < T2 \) < oo. (32b) 

fc=i 

Proof. Again, we concentrate on the necessity, since the sufficiency can be 
proved as in Theorem |2|. To obtain ( |32a| ) first reduce to the decoupled sum 
of squares as in Theorem |] (fl9|) . One, then, has 

P{ V h 2 {X u Yj) A 7 2 2 , > \l 2 2h ) > E Y maxP x ( V h 2 {X u Yj) A ^ > U 2 ^ 
4 Z j<2 k A 

i,j<2 k i<2 k 

Applying Lemma [I] (the case d=l) to the probability appearing in the last 
expectation, we see that 

P Jf £> 2 (X i ,Y i )A<& >\ 1 2 2k )>\l { 



Hence, 



i<2 k 



E Y m&xP x (Y] h 2 (X u Yj) A 7 2 fc > ^7 2 2 fc ) 

j<2 k * — ' I 
%<2 k 

> \p Y (^2 k E x (h 2 A 7 2 fc ) > 7 2 fe ) 

8 i<2 k 

> -^mm(l,2 k P Y (2 k E x (h 2 A^ k ) > 7 2 fe )), 



which implies ( |32a| ). But, we also have 

P(J2 / i 2 (X,,F J )A 7 2 2 fc >72 fc ) 

i,j<2 k 
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Now, using the Section Lemma (Corollary 1) we have that the last quan- 
tity 



And this implies (|32b|) .D 



4 Convergence of series 

In this section we will present the multidimensional generalizations of sym- 
metric case of Kolmogorov three series theorem, which states that for inde- 
pendent random variables Xi the following conditions are equivalent 



> 2- 4 min(l,2 2fc P(/ i 2 A 72 \ > 7*> /*Q0 < 7^)) 



oo 




EiXi is a.s. convergent, 



i=l 



oo 




1=1 



and 



oo 



i=l 



Let us first consider the two-dimensional case and define 



oo 



C, 



• 4 { Xi ) = Y, E Y(hl j (x i ,Y j ) 2 Al), 



oo 

d J (y,) = Y,Ex(hl J (X t ,y j ) 2 Al). 

i=l 
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Theorem 5 Suppose that the functions q, dj are defined as above. Then the 
following conditions are equivalent 

n 

lim e\ ef hij(Xi,Yj) is a.s. convergent, (33) 



hUX^Yj) < oc a.s. (34) 

and 

Ci(Xi) < oo a.s. for alii and dj(Yj) < oo a.s. for all j, (35a) 



^P(QpQ) > 1) < oo and ^P(d 3 (^) > 1) < oo, (35b) 
i=i j=i 



E Yj) A l)/ {Cl( ^)<i,^(^)<i} < °°- ( 35c ) 



Proof. (|33|)<^>(|3~4]). Let us first notice that fl3"3] ) and (|3~4] ) are equivalent, 
respectively to the following two conditions 



V £>0 3„P(sup| ^ ) efh hJ {X u Y J )\>e)<e (36) 

n<i\Jj<k 



k>n 



and 



V £>0 3 n P( ^ hZj(Xi, Yj) >e)<e. (37) 

n<iVj 

By the hypercontractivity of Walshes (i.e., for sums of products of Rademacher 
r.v.'s @ or |[KW2|| , sect. 3.4.) and the Paley-Zygmund inequality we have 

n<i\Jj n<iVj 
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Hence fl36|) implies fl3T|). On the other hand since = ^n<ivj<fc £ \ £ j " , (-^») ^i) 
is a martingale, we get by Doob's inequality 

P(sup | Yl efefh^ Y 3 )\ > t( £ Y})) 1/2 ) < ^ 2 

fc>n — — 
— n<iVj<k n<iVj 

and (|37|) implies (|3~6|). 

By condition (|35|) we get that J2T=i h h( X ^ Y i) < 00 a - s - 
for any % and ^ij( X ii Y j) < 00 a - s - f° r an y i- Hence by condition ( |35b| ) 

it is enough to prove that 

Z =Y1 ( h lj( X " Y i) A 1 ) / {c l (x l )<i,d J (r J )<i} < 00 a.s.. (38) 

However by Chebyshev's inequality 

00 

p(z >t)< r 2 £ E{hU*i, Yj) a i)/{c(jf 4 )<i*m)<i} 

and (H) follows by ( pel) . 

(|3~4|) =^(|35l). Condition Cj(Xj) < 00 a.s. is equivalent to Yl'jLi ^ 2 ,j(^i> Yj) < 
00 a.s., thus (|35a| ) immediately follows by fl3~31). 

To prove the condition (|35b|) let us notice that for sufficiently large n we 
have 

00 

Let us notice that by Lemma 1 (case d = 1) we have for any k > n 

00 00 

i=n,j=l j=l 

Thus 

X 

P( £ h U X > Y i) >^)> 2- 3 P(maxc i (X i ) > 1), 

i=n,j=l 

so P(maXj> n Cj(Xj) > 1) < 1/2, which implies that P{ci{Xi > 1) < 00. 

In an analogous way we prove that YljLi P(^j( Y j) > 1) < 00. 
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Finally let 

oo 

m =Yl E ( h iA X i> Y i) A 1 ) / {ci(^i)<i,d i «)<l}- 

We have 

oo 

E * Yl k iA Xi ' Y i) A lI {ci{Xi)<lMYj)<l} 
i=l 

oo 

< £ A l)I {dj{Yj) <i } < 1 

i=l 

and by a similar argument 

oo 

Hence by Lemma 1 we get 

P(^(/^.pQ,y.) A l)/ {ci( x,)<i >d ,(y,)} > 2 m ) ^ 2- 4 min(m, 1), 

which implies that m < oo. □ 

Before formulating the result in the d- dimensional case we will need a few 
more definitions. Let us define in this case Aq^ = E d and then inductively 
for I = 1, . . . , d - 1, I C {1, 2, . . . , d} with Card(J) = I 

ciAxij) = ^K(tfi I ^) I *-Ui I ^)( Xi *' Xi i') A ^' 
i /' 

= {^i e ^-i,i : Ci/l^ij) < 1 for all / with Card(J) = /} 

Theorem 6 Suppose that Cj / and are defined as above. Then the following 
conditions are equivalent 

£i/ii(Xi) zs a.s. convergent, (39) 
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y~] h?(X{) < oo a.s. 



(40) 



and 



h?(Xi) < oo a.s. for all I with Card(J) —d—1 (41a) 




< oo a.s. for all I with I = Card(J) = 1,2 



,d-l 



(41b) 



(41c) 



Proof. As above. □ 
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